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Abstract 

Given a permutation a = o\ ... a n in the symmetric group S n , we say that <7j matches 
the marked mesh pattern MMP(a, b, c, d) in a if there are at least a points to the 
right of <7j in a which are greater than Uj, at least b points to the left of U{ in a which 
are greater than <7j, at least c points to the left of crj in a which are smaller than <7j, 
and at least d points to the right of cij in a which are smaller than <7j. 

This paper is continuation of the systematic study of the distribution of quadrant 
marked mesh patterns in 132-avoiding permutations started in [9] and [10] where we 
studied the distribution of the number of matches of MMP(a, b, c, d) in 132-avoiding 
permutations where at most two elements of of a, b, c, d are greater than zero and the 
remaining elements are zero. In this paper, we study the distribution of the number 
of matches of MMP(a, b, c, d) in 132-avoiding permutations where at least three of 
a, b, c, d are greater than zero. We provide explicit recurrence relations to enumerate 
our objects which can be used to give closed forms for the generating functions asso- 
ciated with such distributions. In many cases, we provide combinatorial explanations 
of the coefficients that appear in our generating functions. 
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1 Introduction 

The notion of mesh patterns was introduced by Branden and Claesson [2j to provide explicit 
expansions for certain permutation statistics as, possibly infinite, linear combinations of 
(classical) permutation patterns. This notion was further studied in [H El El El El [12] . 

Kitaev and Remmel [6j initiated the systematic study of distribution of quadrant marked 
mesh patterns on permutations. The study was extended to 132-avoiding permutations by 
Kitaev, Remmel and Tiefenbruck in [91 [10], and the present paper continues this line 
of research. Kitaev and Remmel also studied the distribution of quadrant marked mesh 
patterns in up-down and down- up permutations [HE]- 

Let a = o\ . . . o n be a permutation written in one-line notation. Then we will consider 
the graph of a, G(a), to be the set of points (z, ai) for % = 1, . . . ,n. For example, the graph 
of the permutation a = 471569283 is pictured in Figure [TJ Then if we draw a coordinate 
system centered at a point (i,(Ji), we will be interested in the points that lie in the four 
quadrants I, II, III, and IV of that coordinate system as pictured in Figure [U For any 
a,b,c,d G N = {0, 1,2,.. .} and any a = o\. . .a n G S n , the set of all permutations of 
length n, we say that ai matches the quadrant marked mesh pattern MMP(a, b, c, d) in a 
if, in G(cx) relative to the coordinate system which has the point (i, cr^) as its origin, there 
are at least a points in quadrant I, at least b points in quadrant II, at least c points in 
quadrant III, and at least d points in quadrant IV. For example, if a = 471569283, the 
point (T4 = 5 matches the marked mesh pattern MMP(2, 1,2, 1) since, in G(a) relative to 
the coordinate system with the origin at (4, 5), there are 3 points in quadrant I, 1 point in 
quadrant II, 2 points in quadrant III, and 2 points in quadrant IV. Note that if a coordinate 
in MMP(a, b, c, d) is 0, then there is no condition imposed on the points in the corresponding 
quadrant. 

In addition, we considered patterns MMP(a, &, c,d) where a,b,c,d G NU {0}. Here 
when a coordinate of MMP(a, b, c, d) is the empty set, then for Oi to match MMP(a, b, c, d) 
in a = ui . . . a n G S n , it must be the case that there are no points in G(a) relative to the 
coordinate system with the origin at (i, a",) in the corresponding quadrant. For example, if 
a = 471569283, the point a 3 = 1 matches the marked mesh pattern MMP(4, 2, 0, 0) since 
in G(a) relative to the coordinate system with the origin at (3,1), there are 6 points in 
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quadrant I, 2 points in quadrant II, no points in quadrants III and IV. We let mmp^ a ' b ' c '^(cr) 
denote the number of i such that <7j matches MMP (a, b, c, d) in a. 



23456789 



Figure 1: The graph of a = 471569283. 



Note how the (two-dimensional) notation of Ulfarsson [T2] for marked mesh patterns 
corresponds to our (one-line) notation for quadrant marked mesh patterns. For example, 



MMP(0,0,fc,0) 



MMP(fc, 0, 0, 0) 



MMP(0,a,6,c) 



and MMP(O,O,0,fc) 




Given a sequence w — wi . . . w n of distinct integers, let red(u;) be the permutation found 
by replacing the i-th largest integer that appears in a by i. For example, if a = 2754, then 
red(a) = 1432. Given a permutation r = T\ . . . Tj in the symmetric group Sj, we say that 
the pattern r occurs in a = o\ . . . a n G S n provided there exists 1 < %i < ■ ■ ■ < ij < n 
such that red(o"j 1 . . . <7j.) — r. We say that a permutation a avoids the pattern r if r does 
not occur in a. Let S n (r) denote the set of permutations in S n which avoid r. In the 
theory of permutation patterns, r is called a classical pattern. See [1] for a comprehensive 
introduction to patterns in permutations. 

It has been a rather popular direction of research in the literature on permutation 
patterns to study permutations avoiding a 3-letter pattern subject to extra restrictions 
(see [H Subsection 6.1.5]). In [9], we started the study of the generating functions 



V132 



where for any a, b,c,de {0} U N, 



(t,x) 



1 Vn,132 



X) 



n>l 



Q 



(a,b,c,d) 
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E ■ 
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For any a,b,c,d, we will write Qn'132 ( x )\x h f° r t ne coefficient of x k in (5ni32 \ x ) ■ 

There is one obvious symmetry for such generating functions which is induced by the 
fact that if a G *5 n (132), then a -1 G S' n (132). That is, the following lemma was proved in 

Lemma 1. Q9J) For any a, b,c,de {0} U N, 

n (a,b,c,d), \ _ n (a,d,c,b) , s 
Vn,132 \ X J — Vn,132 \ x J • 

In [9], we studied the generating functions Q^' (t, x), Q^li' (t,x) = Q^' '^^^), 
and Q132' (t,x) where k can be either the empty set or a positive integer as well as the 
generating functions Q132' if , x) and Q^'^ if ? x ) ■ m P2], we studied the generating 

functions Qn$S2°\t> x )> Q^vS^fax) = Qnf£'° } (t, x), Qnf^it^) = Qn,132 (t, X ), and 

Qn'i2®' e \ti x )i where k, £ > 1. We also showed that sequences of the form (Qnii^ ( x )U r )n>s 
count a variety of combinatorial objects that appear in the On-line Encyclopedia of Integer 
Sequences (OEIS) [TT]. Thus, our results gave new combinatorial interpretations of certain 
classical sequences such as the Fine numbers and the Fibonacci numbers as well as pro- 
vided certain sequences that appear in the OEIS with a combinatorial interpretation where 
none had existed before. Another particular result of our studies in [9] is enumeration of 
permutations avoiding simultaneously the patterns 132 and 1234, while in [ID] , we made a 
link to the Pell numbers. 

The main goal of this paper is to continue the study of Q^^'^it, x) and combinatorial 
interpretations of sequences of the form (Q^ 132 (aO <\x r )n>s in the case where a, b, c, d G N 
and at least three of these parameters are non-zero. 

Next we list the key results from [9] and [10] which we need in this paper. 



Theorem 2. ([9, Theorem 4]) 



2xt 



and, for k > 1, 



Hence 



and, for k > 2, 



Q^ m (t,x) 

1 £(^132 

1 



l-t Q g^°\t,x) 

Q? 3 f' 0) M) 



1 - t 
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Theorem 3. ([9, Theorem 8]) For k > 1, 



mm _ l + (te-t)(E?^C^)- + (tx - f)(£*:J C 3 P)Y - Atx 

QlZ2 ' V'l x ) — 



2tx 
2 



1 + (tx - t)(E£ C^) + J(l + (te - t)(ES ^)) 2 - 4te 



and 

Theorem 4. ( 77^, Theorem 5]) For all k,£> 1, 



Theorem 5. (723 Theorem 11]) For all k,£>l, 



Ctf + ES ^X 1 " tQ?.2 l '° m (t, x) + t(Q&W*-i) {ti x) _ E ^-i Csts)) 



(2) 



(3) 



Theorem 6. ([10, Theorem 14]) For all k,£>l, 

Cfc-i^- 1 + e ,to (i - tQ^ m (t, x) + t(Q? 3 t l ~ 1A0 \t, x) - e;x 2 C s t s 

Theorem 7. (JJjJ Theorem 17]) For all k,£>l, 

e w (u)=^ (4) 

fc+^-l fc+^-2 /fc-2 / fc-j-2 \\ 

J'=0 j=0 \i=0 \ s =0 J J 

t ( Q ^ m (t, x) - E f g&^(t, x) - £ ar) + 

\ M=0 / \ D = / 

fl-\ / k+t-j-2 

\j=l \ uj=0 

As it was pointed out in [9J, avoidance of a marked mesh pattern without quadrants 
containing the empty set can always be expressed in terms of multi-avoidance of (possibly 
many) classical patterns. Thus, among our results we will re-derive several known facts in 
permutation patterns theory However, our main goals are more ambitious aimed at finding 
distributions in question. 
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Q^\x) = Q^°\x) where k,£,m > 1 



By Lemma CD, we know that QniiT ( x ) = Qn,i32'°\ x ) ■ Thus, we will only consider 

Qnf^'°\ x ) i n this section. 

Throughout this paper, we shall classify the 132-avoiding permutations a = o\ . . . a n by 
the position of n in a. That is, let Sn\l32) denote the set of a G 5^(132) such that Oi = n. 
Clearly each a G Sl^(132) has the structure pictured in Figure [2j That is, in the graph of 
a, the elements to the left of n, A4 (a), have the structure of a 132-avoiding permutation, 
the elements to the right of n, B^a), have the structure of a 132-avoiding permutation, 
and all the elements in Ai(a) lie above all the elements in Bi(a). It is well-known that the 
number of 132-avoiding permutations in S n is the Catalan number C n = ^-j- ( 2 ™) and the 
generating function for the C n 's is given by 

c(t) = y ax = I^Z? = 



4. (a) 



R • (a) 



Figure 2: The structure of 132-avoiding permutations. 

Suppose that n > I. It is clear that n can never match the pattern MMP(/c, £, m, 0) 
for k,m > 1 in any cr G 5' n (132). For 1 < i < n, it is easy to see that as we sum over all 
the permutations a in Sn\l32) } our choices for the structure for Aj(cr) will contribute a 
factor of 1 X32 1 '°\ X ) to Qi^is™' ^)- Similarly, our choices for the structure for Bi(a) will 

contribute a factor of Q^-^im^ ( x ) t° Qrfis™' '' ( x ) Hi < £ since o~i . . . will automatically 
be in the second quadrant relative to the coordinate system with the origin at (s, cr s ) for 
any s > i. However if i > £, then our choices for the structure for Bi{a) will contribute a 
factor of Qn-iv^{ x ) to Q^xaa'^ ( x ) • ft follows that for n > £, 

i-l n 

n (k,e,m,0) ( v _ V^^^-l^m.O)/ v n (M-<.m,0)/ x , n (fc-l,£,m,0) / s n (fe,0,m,0) / x 

Vn,132 \ x ) — 2_^t ^i— 1,132 WVn-j,132 W ~t~ Vj-1,132 l x JVn-i,132 

i=l i=£ 

Note that for % < £, Q^Ym" 1 ' ( x ) = C»-i- Thus, for n> £, 

1-1 n 

Qi k s fi \ x ) = z^Qi^r^) + e^^^qss^). (5) 

i=l i=£ 
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Multiplying both sides of (jSJ) by t n and summing for n > £, we see that for k, £ > 1, 

Q^' m '°\t, *) = E + ]T cu* £ gi^^r + 

j'=0 i=l u>i—i 

n 

= E ^ + E ^ f f ^ " J ' m,0) (*, *) - e' c ^ 

3=0 i=l \ i=0 

tQf 32 °< m ' 0) (t,*) (gSt^c*,*) - E^ s 

V s=0 

= ciwt*- 1 + tg! fc 3 2°' m ' 0) (t, *)g?32 1Am ' 0) (*, x) + 



l-1-s 



c s t s i + tQ^t'-^it, x) - tg£ 2 °' m ' 0) (t, x)-tJ2 W 

s=0 \ j=0 



Thus, we have the following theorem. 
Theorem 8. 

Q^ m '°\t,x) = C e ^- 1 + tQ^\t,x)Q^ mfi) (t,x)+ 



l-1-s 



E C s t s 1 + tQSt 1 -'^, x) - tQ^ m '°\t, x)-tJ2 W . (6) 

s=0 \ j=0 / 

Note that since we can compute gi32°' m '°^(t, x) by Theorem @] and Qi32 ,m,Q ^(t, x) by 
Theorem El we can use (jSJ) to compute Qisa ,m '°\t,x) for any k,£,m> 1. 

2.1 Explicit formulas for Q^i^ \ x )\x r 
It follows from Theorem [8] that 

Q[ k £ m '°\t,x) = l + tQfi^\t : x)Q%- l ^°\t,x) (7) 

and 

g? 32 2,m ' 0) (*, = i + tgSf m ' 0) (t, x)(gf 3 - x) - 1) + tgf3 2 1,m ' 0) (t, *). 

Note that it follows from Theorems H] and [6] that 

QU' m (t,0) = l + tQ^°\t,0)Q^ o \t,0) 

l-t 1-t l-3t + 2t 2 + t 3 

= 1+* = 7 \n • 

1 - 2t 1 - 2t (1 - 2t) 2 
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Thus, the generating function of the sequence (Q^i32' ' 1 (0))n>i is (jE^Y which is the gen- 
erating function of the sequence A045623 in the OEIS. The n-th term a n of this sequence 
has many combinatorial interpretations including the number of Is in all partitions of n + 1 
and the number of 132-avoiding permutations of S n+ 2 which contain exactly one occurrence 
of the pattern 213. We note that for a permutation a to avoid the pattern MMP(1, 1,1,0), 
it must simultaneously avoid the patterns 3124, 4123, 1324, and 1423. Thus, the number 
of permutations a G S' n (132) which avoid MMP(1, 1, 1, 0) is the number of permutations in 
S n that simultaneously avoid the patterns 132, 3124, and 4123. 

Problem 1. Find simple bijections between the set of permutations a G S n (132) which 
avoid MMP(1, 1,1,0) and the other combinatorial interpretations of the sequence A045623 
in the OEIS. 

Note that it follows from Theorem H] and our previous results that 

QU X °\t,0) = l + tQ^°\t,0)Q^°\t,0) 

l-2t fl-3t + 2t 2 + t z 

= 1 + t- 



1 - 3t + t 2 V (1 - 2t) 2 
1 - At + At 2 + t 4 



l-5t + 7t 2 - 2t 3 ' 



The sequence (Qni32°\®))n>i is the sequence A142586 in the OIES which has the generat- 

mg mnction (13w2)(12t) . inat is, 1 _ 5t+w a_ 2t 3 1 - (i- 3 t+t 2 )(i-2t) • ims sequence nas no 
listed combinatorial interpretation so that we have found a combinatorial interpretation of 
this sequence. 



Similarly, 



Q^°\t,0) = l + tQ^'°\t,0)Q^°\t,0) 

l-3t + t 2 1 - At + At 2 + t 4 

1 ~\~ t 



l-At + 3t 2 l-5t + 7t 2 -2t 3 
1 - 5t + It 2 - 2t 3 + t 5 



1 - 6t + lit 2 - Qt 3 



Q^' m (t,0) = l + t Q ^\t,0)Q^ 2fi \t,0) 

1-t-t 2 l-t-t 2 

1 + t- 



\-2t-t 2 \-2t-t 2 
1 - 3t + 3t 3 + 3t 4 + t 5 
(l-2t-t 2 ) 2 ' 

Q$™\t,0) = l + tQ^°\t,0)Q^' m (t,0) 

\-2t-t 2 1 - 3t + 3t 3 + 3t 4 + t 5 
= l+t- 



l-3t + t 3 (\-2t-t 2 ) 2 
1 - At + 2t 2 + At 3 + t A + 2t b + t & 
(l-2t-t 2 )(l-3t + t 3 ) ' 
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Using (J7|) and Theorem HI we have computed the following. 



<2i32 (*, x) = l + t + 2t 2 + 5t 3 + (12 + 2x)t 4 + (28 + 12x + 2x 2 ) t 5 + 
(64 + 48x + 18a; 2 + 2x 3 ) t 6 + (144 + 160a; + 97x 2 + 26a; 3 + 2a; 4 ) t 7 + 
(320 + 480a; + 408a; 2 + 184a: 3 + 36x 4 + 2a: 5 ) t 8 + 
(704 + 1344a: + U79x 2 + 958a; 3 + 327a; 4 + 48x 5 + 2a; 6 ) t 9 + ■ ■ ■ . 

Qvn' 2 ' 0) (t, x) = l + t + 2t 2 + 5t 3 + Ut 4 + (38 + 4a;)t 5 + (102 + 26a; + 4a; 2 ) t G + 
(271 + 120x + 34a; 2 + 4x 3 ) t 1 + (714 + 470x + 200a; 2 + 42a; 3 + 4a; 4 ) t 8 + 
(1868 + 1672a; + 964x 2 + 304a; 3 + 50a; 4 + 4a; 5 ) t 9 + ■ ■ ■ . 

Qi32 3 '°\t, x) = 1 + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + (122 + 10x)t 6 + 
(351 + 68a; + 10x 2 ) t 7 + (1006 + 326a: + 88a: 2 + 10x 3 ) t 8 + 
(2868 + 1364a; + 512a; 2 + 108a: 3 + 10a; 4 ) t 9 + • • • . 

We can explain the highest and second highest coefficients of x in these series. That is, 
we have the following theorem. 

Theorem 9. 

(i) For all m > 1 and n > 3 + m, the highest power of x that occurs in Qn i3™ { x ) ^ s 
x n-2-m yjfccfo a pp ears w ah a coefficient of 2C m . 



(ii) For n>5, Q { ^\x)\ xn -, = 6 + 2(" 2 2 ) . 

(Hi) For m > 2 and n > 4 + m QniiT ( x )\x n - 3 - m = 2C m+ i + 8C m + 4C m (n — 4). 



Proof. It is easy to see that for the maximum number of MMP(1, 1, m, 0)-matches in a a G 
S' n (132), the permutation must be of the form (n— l)r(m+l) . . . (n— 2)n or nr(m+l) . . . (n— 
2){n — 1) where r G S' m (132). Thus, the highest power of x occurring in Qni32'°\x) is 
x n-2-m w h\oh occurs with a coefficient of 2C m . 

For parts (ii) and (iii), we have the recursion that 



n (l,l,m,0) 
Vn,132 



i=l 



We proved in [10] that the highest power of x which occurs in either Q 



,(0,1,TO,0) 
n,132 



Qi!i°32 m ' 0) (^) is x n ~ x ~ m and 




.n — 1 — m — 



a 
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It is then easy to check that the highest coefficient of x in Qf^l' 7 ^^ i' 132'' ( X ) i S 

less than x n ~ 3 ~ m for i — 3, . . . , n — 3. 
We also proved in [10] that 

Qn,132°\ X )\x"-3 = Qn,132 0) ( X )\x"-3 = 2 + (^ 2 ^ iOT U ~ 4 &Ild 

o Q.fl,m,0), xi _ o (Q,l,m,0) r N, 

V n ,132 W|a;"- m - 2 — Vn,132 Wli"-" 1 " 2 

= C m+ \ + C m + 2C m (n — 2 — m) for 72 > 3 + m and m > 2. 

For m = 1, we are left with 4 cases to consider in the recursion ([H]). We start with the 
m = 1 case. 

Case 1. i = 1. In this case, Qi-]jS(x)Q^f;^(x)\ x n-4 = QM,i2(aOI*»-« and 

«3wi— 2 +( n 2 2 ) forn ^ 5 - 

Case 2. « = 2. In this case, Qf-i^ 2 \ x )Qn-ilill{ x )\x^ = Q^& x )\^-* and 

Qn-a.iSWU' 1 - 4 = 1 for n > 5. 
Case 3. i = n - 1. In this case, Q .'};}^ ^tfl^lS = QSi'S^JU"-* and 

Qn-ai'Sz^U"- 4 = 1 for n > 5. 
Case 4. i = n. In this case, Q|°'i'i32 (^Qn-^'m^U" -4 = Qn-i 132 O^) I a;"- 4 and 

QK 3 °k^)U- 4 = 2+( n 2 2 ) for 77 > 5. 

Thus, QK 2 1,0) Or)U-4 = 6 + 2(V) for 77 > 5. 

Next we consider the case when m > 2. Again we have 4 cases. 

Case 1. 7 = 1. In this case, Q^l'^^^Qn-iTm ( x )\x n ^ 3 - m = Qn-i™32 ( x ) U™- 3 -™ and 

Qn-i™xt i x )\x"-*-t = Cm+i + C m + 2C m (n - 3 - m) for 77 > 4 + m. 
Case 2. 7 = 2. In this case, Q\ \ 132 i i32^(^ , )l^'* n m = 2 132^ (^Ol^ 71- 3— m and 

Qn-l^T^ ( X ) U™- 3 -" 1 = Cm for 77 > 4 + 777. 

Case 3. i — n — 1. In this case, Q^\'^2\ x )Qn-iT32 ( x )\x n - 3 - m — Qn-2132 i x ) U™- 3 -™ and 

Qi°-2™32^ ( X ) U"" 3 " m = C m for 77 > 4 + 772. 
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Case 4. i — n. In this case, ( x )Qn-i^32\ x )\x n - 3 ~ m — Qn-i ™32 ( x ) \x n ~ 3 -™ and 

Qn-i™32 ( x )\x n - 3 - m = C m +i + C m + 2C m (n — 3 — m) for n > 4 + m. 
Thus, for n > 4 + to, 

<5n,i3r 0) (^)U«-3- = 2C m+1 +4C m + 4C m (n-3-m) 
= 2C m+1 + 8C m + 4C m (n-4-m). 

Thus, when to = 2, we obtain that 

QK' 0) (aOU»- B = 26 + 8(n - 6) for n > 6 
and, for m = 3, we obtain that 

<3i i32 ,0) (^)U-e = 68 + 20(n - 7)for n > 7 
which agrees with our computed series. □ 
We also have computed that 

Qv£' 1,0 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + (39 + 3x)t 5 + (107 + 22a; + 3x 2 ) t 6 + 
(290 + 105x + 3lx 2 + 3x 3 ) f + (779 + 415a; + 190a; 2 + 43a: 3 + 3a; 4 ) t s + 
(2079 + 1477a; + 909a: 2 + 336a; 3 + 58a; 4 + 3a; 5 ) t 9 + 
(5522 + 4922x + 3765a; 2 + 1938a: 3 + 570a; 4 + 76a: 5 + 3x 6 ) t 10 + • • • , 

<2?32' 2 ' 0) (^ x ) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + (126 + 6x)t 6 + (376 + 47a: + 6x 2 ) t 7 + 
(1115 + 250a; + 59x 2 + 6x 3 ) t s + (3289 + 1110a: + 386a: 2 + 71a: 3 + 6x 4 ) t 9 + 
(9660 + 4444a: + 2045a; 2 + 558a: 3 + 83a: 4 + 6x 5 ) t 10 + • • • , and 

Qi32 3 '°\t, x) = l + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + 132t 6 + (414 + 15a:)t 7 + 
(1293 + 122a; + 15a: 2 ) t 8 + (4025 + 670a: + 152a: 2 + 15a: 3 ) t 9 + 
(12486 + 3124a: + 989a: 2 + 182a: 3 + 15a: 4 ) t 10 + ■ ■ ■ . 

Again one can easily explain the highest coefficient in Qn'i32'°\ x )- That is, to have the 
maximum number of MMP(2, 1, m, 0)-matches in a a G S'„(132), the permutation must be 
of the form 

(n — 2)r(m + 1) . . . (n — 3)(n — l)n, 
(n — l)r(m + 1) . . . (n — 3)(n — 2)n, or 
nr(m + 1) . . . (n - 3)(n - 2)(n - 1) 
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where r G S m (132). Thus, the highest power of x occurring in Qn,i32'°\ x ) * s x n ~~ 3 ~ m which 
occurs with a coefficient of 3C m . 
We have computed that 

Qi£' m {t, x) = l + t + 2t 2 + ht 3 + Ut 4 + (37 + 5x)t 5 + (94 + 33x + 5x 2 ) t 6 + 
(232 + lUx + 48x 2 + 5x 3 ) f + (560 + 520x + 277x 2 + 68x 3 + 5x 4 ) t 8 + 
(1328 + 1680x + 1248x 2 + 508x 3 + 93x A + 5x 5 ) t 9 + ■ ■ ■ . 

Q { i£ m (t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + (122 + 10x)t 6 + 
(348 + 71a; + 10x 2 ) t 7 + (978 + 351x + 9lx 2 + 10x 3 ) t 8 + 
(2715 + 1463x + 563x 2 + lllx 3 + 10x 4 ) t 9 + ■ ■ ■ , and 

Qi32 ,3 ' 0) (*. x ) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + (404 + 25x)t 7 + 
(1220 + 185x + 25x 2 ) t 8 + (3655 + 947x + 235x 2 + 25x 3 ) t 9 + ■ ■ ■ . 

Again, one can easily explain the highest coefficient in Qni32'°\ x )- That is, to have 
the maximum number of MMP(1, 2, m, 0)-matches in a a G S n (132), one must be of the 
form 

(n — 2){n — l)r(m + 1) . . . (n — 3)n, 
(n — l)(n — 2)r(m + 1) . . . (n — 3)n, 
n(n — 2)r(m + 1) . . . (n — 3)(n — 1), 
n(n — l)r(m + 1) . . . (n — 3)(n — 2), or 
(n — l)m~(m + 1) . . . (n — 3)(n — 2) 

where r G S m (132). Thus, the highest power of x occurring in Qn,i32'°\ x ) i s x n ~ 3 ~ m which 
occurs with a coefficient of 5C m . 
Finally, we have computed that 

Qiv^it, x) = l + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + (123 + 9x)t 6 + (351 + 69x + 9x 2 ) t 7 + 
(982 + 343x + 96x 2 + 9x 3 ) t 8 + (2707 + 1405x + 609x 2 + 132x 3 + 9x 4 ) t 9 + ■ ■ ■ , 

<5i32' 2 ' 0) (^ x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + (411 + 18x)t 7 + 
(1265 + 147x + 18x 2 ) t 8 + (3852 + 809x + 183x 2 + 18x 3 ) t 9 + 
(11626 + 3704x + 1229x 2 + 219x 3 + 18x 4 ) t 10 + • • • , and 

<3S 2 32 2 ' 3 ' 0) (^ x ) = 1 + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + 132t 6 + 429t 7 + (1385 + A5x)t 8 + 
(4436 + 381z + 45z 2 ) t 9 + (14118 + 2162x + 471x 2 + 45z 3 ) t 10 + 
(44670 + 10361x + 3149x 2 + 561x 3 + 45x 4 ) t n + ■ ■ ■ . 
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Again, one can easily explain the highest coefficient in Q n y™' (x). That is, to have 
the maximum number of MMP(2, 2, m, 0)-matches in a a G <S n (132), one must be of the 
form 
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where r G <S m (132). Thus, the highest power of x occurring in Q n ' 13 '™' (x) is x n 4 m which 
occurs with a coefficient of 9C m . 



3 <t^ m) (*) = Q { n$' k \x) where k,£,m>l 

By Lemma[H we only need to consider Q^xi?!™^ ( x ) ■ Suppose that k,£,m > 1 and n > k+m. 
It is clear that n can never match the pattern MMP(0,fc,f,m) for k,£,m > 1 in any 
o G 5 n (132). If a = G\ . . . a n G 5 n (132) and crj = n, then we have three cases, depending 
on the value of i. 

Case 1. i < k. It is easy to see that as we sum over all the permutations a in 5^(132), our 
choices for the structure for Ai(a) will contribute a factor of Cj_i to Qn'132 ( x ) srnce none 
of the elements Oj for j < k can match MMP(0, k,£,m) in a. Similarly, our choices for the 

structure for Bi(a) will contribute a factor of Qn-iiiv \ x ) ^° Qn i32' m \ x ) srnce &x ■ ■ ■ °i 
will automatically be in the second quadrant relative to the coordinate system with the 
origin at (s, a s ) for any s > i. Thus, the permutations in Case 1 will contribute 

i=l 

to Qi°S' m) (*). 

Case 2. k < i < n — m. It is easy to see that as we sum over all the permutations 
a m our choices for the structure for A,i{a) will contribute a factor of Q[°1i (x) 

to Qn'i32 m \ x ) since the elements in B{(a) will all be in the fourth quadrant relative to a 
coordinate system centered at (r, a r ) for r < i in this case. Similarly, our choices for the 
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structure for Bi(a) will contribute a factor of Qn-i 132 ( x ) t° Qnisa"^ ( x ) since o\ . . . o, L will 
automatically be in the second quadrant relative to the coordinate system with the origin 
at (s, a s ) for any s > i. Thus, the permutations in Case 2 will contribute 



to Q%£ m \x). 



Case 3. i > n — m + 1. It is easy to see that as we sum over all the permutations a in 
our choices for the structure for Ai(a) will contribute a factor of Qi-1'1'32 (x) 

to Q„i*2 (2) since the elements in Bi(a) will all be in the fourth quadrant relative to a 
coordinate system centered at (r, a r ) for r < i in this case. Similarly, our choices for the 
structure for Bi(a) will contribute a factor of C n _j to Q^i^'™^ ( x ) since the elements in 
Bi(a) do not have enough elements to the right to match MMP(0, k, £, m) in a. Thus, the 
permutations in Case 3 will contribute 

n 

E n (0,k,i,m-(n-i)) f s r 

i=n— m+1 

to Q„ '1^2'^ i x ) ■ Hence, for n > k + m, 

k—l n—m 

Q ( :t£ m \ x ) = E ^-i«^' m) (-) + E ^ } + 

n 

E QKj 3 2" (n - i)) (^)C'n- i . (9) 
i=n— m+1 

Multiplying ([9]) by t™ and summing, it is easy to compute that 

fc+m— 1 

Q!°32 M ' m) (M) = E + 

k-2 / k-i+m-2 



Y,C t fltQ? 3 t 1 - lAm \t,x)-t E C ^ 

i=0 \ r=0 

t (q^\t, X) - g ^ ^S°32°'^V, *)-£ ^ ) + 
m— 1 / fc+m— j— 2 



i=o \ s=o 

Note that the j = term in the last sum is tQ^' 1 (£, x) — t X!s=cT~ 2 C s t s - Thus, taking 
the term tQf^2 ,l ' m \t, x) over to the other side and combining the sum t X]s=cT _2 C s t s with 
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the sum EjST' 1 C P t p to obtain C k + m - X #* mr ~ x + (1 - t) E^5T~ 2 c P t p and then dividing 
both sides by 1 — t will yield the following theorem. 



Theorem 10. 



fc+m-2 ^ f.k+m-1 



p=0 



k-2 / fc-i+m-2 



8=0 \ r=0 



a=0 / \ f>=0 

m— 1 / fc+m— j— 2 



i=l \ s=0 

Note that since we can compute Qf^^^.x) = Q^' i,k \t,x) by Theorem 0, we can 
compute Qi32 ' e (t, x) for all k,£,m> 1. 



3.1 Explicit formulas for Q^£ m) ( x ) I 

It follows from Theorem [10] that 



Q?^ l \t,x) = i + ^ + ^g& 1A0) (t,x)(gjr i) (*^)-i) 
1 +AQ& U0 H*^)(«Sf <,1) (*^)-i). 



1 - * 1 - t 

t2 (Q^\t,x)-l), 



l-t 



and 



Qf 3 f' 2) (t,x) = l + t + 2t 2 + ^ + ^(gS 3 2 1 ^(t,x)-(l + t + 2^)) + 

* (QSf'^M)-i)(Qf 3 f' 2) (^)-(i + *)) + 
(0& aA1) («,x)-(i + t)). 



l - 1 
t 2 



l - 1 

We used these formulas to compute the following. 
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Qi32 (t, x) = 1 + t + 2t 2 + 5t 3 + (13 + x)t 4 + (33 + 8x + x 1 ) t 5 + 
(81 + 39a; + llx 2 + x 3 ) t 6 + (193 + 150x + 70x 2 + 15a; 3 + x 4 ) t 7 + 
(449 + 501a: + 337a: 2 + 122a; 3 + 20a: 4 + a: 5 ) t 8 + 
(1025 + 1524a; + 1363a; 2 + 719a: 3 + 204a: 4 + 26a; 5 + a; 6 ) t 9 + 
(2305 + 4339a: + 4891a; 2 + 3450a; 3 + 1450a; 4 + 327a; 5 + 33a: 6 + x 7 ) t 10 + ■ ■ ■ . 

Qvn'^Ht, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 2(20 + x)t 5 + (113 + 17a; + 2a; 2 ) t 6 + 
(314 + 92a; + 21a; 2 + 2a; 3 ) t 7 + (859 + 404a: + 140a; 2 + 25a; 3 + 2a; 4 ) t 8 + 
(2319 + 1567a: + 745a; 2 + 200a; 3 + 29x 4 + 2x 5 ) t 9 + 
(6192 + 5597a; + 3438a; 2 + 1262a: 3 + 272a; 4 + 33a; 5 + 2a; 6 ) t 10 + • • • . 

QiSb 1 ' 3 ' 1 ^*, x) = 1 + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + (127 + 5x)t 6 + (380 + 44a; + 5a; 2 ) t 7 + 
(1125 + 246a; + 54a: 2 + 5a: 3 ) t 8 + (3299 + 1135a; + 359a: 2 + 64a: 3 + 5a: 4 ) t 9 + 
(9592 + 4691a: + 1942a; 2 + 492a; 3 + 74a; 4 + 5a; 5 ) t w + ■ ■ ■ . 

Our next theorem will explain the coefficient of the highest and second highest powers 
of x that appear in Q^fii ( x ) i* 1 these series. 

Theorem 11. 

(i) For n > 3 + £, the highest power of x that occurs in Qn'132 ( x ) is x n ~ 2 ~ e which 
appears with a coefficient of Cg. 

(li) For n>5, ( x ) U w " 4 = 5 + CV) • 

(m) For all£>2andn>A + t, Q { ^ X) (x) | x „-s-< = C e+ i + 6Q + 2d(n -i-£). 

Proof. It is easy to see that the maximum number of matches of MMP(0, 1,£, 1) that are 
possible in a 132- avoiding permutation is a permutation of the form n a (n — 1) (3 where a 
is a 132-avoiding permutation on the elements n — £ — 1, ... ,n — 2 and j3 is the decreasing 
permutation on the elements 1, . . . , n — £ — 2. Thus, the highest power in IS X 

which has a coefficient of Cg. 

For parts (ii) and (iii), we note that it follows from Q that 

n-1 

Qn,132 ( X ) = Qn-l,im{ X ) + / ] Qj-'l,132 ( X )Qn-ll32( X ) ■ 

i=l 

We proved in [10] that the highest power of x that appears in Q^iii {x) = Qnii^i 00 ) * s 
x n-e-i wn j cn appears with a coefficient of Cg for n > I + 2. This implies that the highest 
power of x that appears in Q^{ l ^{x)Q^f^ 2 {x) is less than x n ~ e ~ 3 for i = 3, . . . , n — 2. 
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Hence we have four cases to consider when we are computing Q^iil ( x )\x n - i - 

Case 1. i = 1. In this case, Qi-l'l^ (^Qn-i^l ( x )\x™- 4 — Qn-i^ilii^lx™- 4 ' an d we proved 
in [TO] that 

Case 2. i = 2. In this case, Qi°'i'i32H x )Ql - /i32 ( X )U™- 4 — Qn-2m2,{ x )\x n - A an d we proved 
in [TO] that 

Qn-iiS^U™- 4 = 3)^132 0*0 lx»-« = 1 for n > 5. 

Case 3. i = n - 1. In this case, Qf-ljS( x )Qn-i!i32( x )\x™-* = Qi-^iS (>)U- 4 and we 
proved in [10] that 

Qn-i'SWU"- 4 = 1 for n > 5. 
Case 4. Q^-i 132 ( X )U"- 4 - By part (i), we know that 132 (^OU™- 4 = 1 for n > 5. 

Thus, Q^i'^ix)]^ = 5 + ( n " 2 ) for n > 5. 

Again there are four cases to consider when computing Qn-i,i3\{ x )\x n - :i - i for £ >2. 

Case 1. 2 = 1. In this case, Qf^ii^l{x)Q^f{^ 2 {x)\ xn --i-i = Qn-fn2( x )\x n - 3 - e an d we 
proved in [JO] that 

Qn-i,132( X )\x"- 3 - e — Qn-i,l32( X )\x n - n - 3 - e 

= C e+1 + C i + 2C e (n-3-£) 

= C e+l + 3Q + 2CfXn - 4 - £) for n > 4 + L 

Case 2. z = 2. In this case, Qilx^l{x)Q^i^ 2 {x)\ xn - 3 -i = Q^y&Wl*"- 3 -* and we 
proved in [TO] that 

Qn-"^^) la"" 3 "' = Qn-2%( X )\x"-3-e = C £ for U > A + £. 

Case 3. i = n - 1. In this case, Q^S^^n-^ = QSSWU- 3 ^ and we 

proved in [10] that 

Qn-afiSfa)!^- 3 -' = Ci for n > 4 + £. 
Case 4. Qi !. 1 !^^^)!^"- 3 -^ • By part (i), we know that 

Qn-ti32( x )\x^-'i-t = Q for n > 4 + £. 

Thus, 

QnM l \x)\ xn - 3 -i = C e+1 + 6C e + 2C e (n - 4 - f) for n > 4 + 1 
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For example, when I = 2, we have that 

Qn'i£' 1] ( x )^ n - 5 = 17 + 4 ( n - 6) for n > 6 
and, for £ = 3, we have that 

QlS'^Wk' = 44 + 10(n - 7) for n > 7 
which agrees with the series we computed. □ 

The sequence (Qn'hl'^i^n^i starts out 1,2,5,13,33,81,193,449,.... This is the se- 
quence A005183 in OEIS. Using the fact that Q^ ,lfi \t,0) = QS?' 1 ' 1 ^*, 0) = jf|, one can 
show that 

O (o,i,i,i)/ f r) _ l-4t + 5t 2 -t 3 
^ 132 1 ' j " (i_2t)2(l-t) 

from which it is possible to show that Qnfyl'^fi) — ( n ~ l)2 n ~ 2 + 1 for n > 1. 

The sequence (Qi°i32' 1 ' ) ( :c )U)n>4 starts out 1,8, 39, 150, 501, 1524 . . .. This seems to be 
the sequence A055281 in the OEIS. The n-th term of this sequence (n 2 — n + 4)2™ +1 — 7 — n 
and is the number of directed column- convex polyominoes of area n + 5 having along the 
lower contour exactly 2 reentrant corners. 

Problem 2. Verify that the sequence (Qn,i32 1 \ x )\x)n>A is counted by 

{n 2 - 9n + 24)2"- 3 - 3 - n 

and if so, find a bijective correspondence with the polyominoes described in A055281 in 
the OEIS. 

We have computed that 

Qi32 1,2) (t,x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 2(20 + x)t 5 + (ill + 19x + 2x 2 ) t 6 + 

(296 + 106a; + 25x 2 + 2x 3 ) t 7 + (761 + 456x + 178x 2 + 33x 3 + 2x 4 ) t 8 + 

(1898 + 1677a; + 947x 2 + 295x 3 + 43x 4 + 2x 5 ) t 9 + 

(4619 + 5553a; + 4191a; 2 + 1901a; 3 + 475a; 4 + 55a; 5 + 2x 6 ) t 10 + • • • . 

Qi32 2 ' 2 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 4(32 + x)t 6 + 
(385 + 40x + 4a; 2 ) t 7 + (1135 + 243a; + 48x 2 + 4a; 3 ) t 8 + 
(3281 + 1170a; + 351a; 2 + 56x 3 + 4x 4 ) t 9 + 
(9324 + 4905x + 2016a: 2 + 483x 3 + 64x 4 + 4x 5 ) t 10 + • • • . 

Q { i32 3 ' 2 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + (419 + 10x)t 7 + 
(1317 + 103a; + 10x 2 ) t 8 + (4085 + 644a: + 123a; 2 + 10x 3 ) t 9 + 
(12514 + 3229a: + 900a: 2 + 143a; 3 + 10a: 4 ) t 10 + 
(37913 + 14282a; + 5222a: 2 + 1196a: 3 + 163a: 4 + 10a: 5 ) t u + ■ ■ ■ . 

Again we can explain the coefficients of the highest and second highest coefficients in 
Qn'i32 ,2 \ x ) f° r large enough n. 
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Theorem 12. 

(%) For n > £ + 4, i/ie highest power of x that appears in Qni32 2 \ x ) ^ s x n ~ 3 ~ e which 
occurs with a coefficient of2Ce- 

(ii) For n>7, Q%$ 2) (x)\ xn -* = 13 + 

(Hi) For all £>2 and n > 5 + £, Q { °££ 2) (x) \ x n-*-t = 2C t+1 + 15C t + AC E (n -5-£). 

Proof. For (i), it is easy to see that the maximum number of matches of MMP(0, 1,£, 1) 
that are possible in a 132-avoiding permutation is a permutation of the form n a (n — 1) 
where a is a 132-avoiding permutation on the elements n — £ — 1, ... ,n — 2 and (3 = 
(n - £ - 2)(n - £ - 3) . . . 321 or /3 = (n - £ - 2)(n - 1 - 3) . . . 312. Thus, the highest power 
in Qn'132 ^ i x ) i s x n ~ e ~ 3 which has a coefficient of 2Ce. 

For (ii) and (iii), we note that the recursion for Qnim 2 \ x ) * s 

Qn,132 \ x ) = Qn-i,132( x ) + Qn-2,132 ( X ) + Qi-'l,'l32 ( X )Qn-i,132 ( X ) ■ 

i=l 

Since the highest power of x that occurs in Q^im \ x ) ls xn ~ 1 ~ e an d the highest power 
of x that occurs in Q^fii' ( x ) is n — 2 — £, it follows that the highest power of x that occurs 
in Qj^i'i^ ]( x )Qn-/i3a( x ) * s ^ ess t nan x™ -4- ^ for i — 4, . . . , n — 3. 

Thus, we have to consider five cases when computing Qni^ 2 \x)\ x n-i-t. 

Case 1. Qn-tim{ x )\ x ^-i- By part (i), 

Qn-i%( x )l^-t = 2Q for n > £ + 5. 
Case 2. Q^-2vk{ x )\x n -*- 1 - We have shown earlier that 

Qn-i'SCaOU"-*-* = G for n > £ + 5. 

Case 3. i = n — 2. In this case, Q^'i'^ ( a: )Qn-i'i'az( x ) eo ± ua l s 2Qi°l3^32( :c )- We have shown 
in [10] that <5r^3^L32 C 37 ) I a:"-- 4 -* = Q for n > ^ + 5 so that we get a contribution of 2Cg in 
this case. 

Case 4. i = 2. In this case, '^(xjQ^'^f^a;) equals Qi^/i^t^)- We have shown in 
[JO] that 

Qi-3?32(^)U»-^ = 2Q forn > £ + 5. 



en 
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Case 5. i — 1. In this case, <5i-i'i32 ( x )Qn-/i32( x ) equals Qn-iim{ x )- We have shown in 
[ID] that for n > £ + 5, 

o(o.W^| 4 , = /6 + 2(V) 

Vn- 3 ,i32V ;ix~ |2C m + 8Q + 4Q(n-5-£) if £ > 2. 



Thus, for £ = 1, we get 



Qi-S = 13 + 2( ^ 2 2 ) forn > 6 



and, for £ > 2 

)(0,1,€,2) 



Q^4'^(x)| x „-4- f = 2C e+1 + 15C e + 4C*(n - 5 - £) for n > 5 + 1 
For example, when ^ = 2, we get 

Q%5?$(x)\ x n- e = 40 + 8(n - 7) for n > 7 

and, for £ = 3, we get 

Qn-Sh^U- 6 = 103 + 20 ( n - 8) for n > 8 
which agrees with the series that we computed. □ 

Qi32 ,1,2) (*, a;) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 4t 6 (32 + x) + (380 + 45x + 4x 2 ) t 7 + 
(1083 + 286x + 57x 2 + 4x 3 ) t 8 + (2964 + 1368x + 453x 2 + 73x 3 + 4x 4 ) t 9 + 
(7831 + 5501x + 2650x 2 + 717x 3 + 93x 4 + 4x 5 ) t 10 + 
(20092 + 19675x + 12749x 2 + 5035x 3 + 1114x 4 + 117x 5 + 4x 6 ) t 11 + • • • . 

<9S°32 2 ' 2 ' 2) (^ x) = 1 + t + 2t 2 + 5t 3 + Ut 4 + A2t> + 132t 6 + (421 + 8x)t 7 + 
(1328 + 94x + 4x 2 ) t 8 + (4103 + 641x + 110x 2 + 8x 3 ) t 9 + 
(12401 + 3376x + 885x 2 + 126x 3 + 8x 4 ) t 10 + 
(36740 + 15235x + 5484x 2 + 1177x 3 + 142x 4 + 8x 5 ) t n + 
(106993 + 62012x + 28872x 2 + 8452x 3 + 1517x 4 + 158x 5 + 8x 6 ) t 12 + ■ ■ ■ . 

Qi32 3 ' 2 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + 429t 7 + 

(1410 + 20x)t 8 + (4601 + 241x + 20x 2 ) t 9 + (14809 + 1686x + 281x 2 + 20x 3 ) t 10 + 

(46990 + 9187x + 2268x 2 + 321x 3 + 20x 4 ) t n + 

(147163 + 43394x + 14144x 2 + 2930x 3 + 361x 4 + 20x 5 ) t 12 + ■ ■ ■ . 

It is easy to explain the coefficient of the highest power in Qn' 2,e ' 2 \x). That is, the max- 
imum number of matches of MMP(0, 2, £, 2) that are possible in a 132-avoiding permutation 
is a permutation of the form n(n — 1) a (n — 2) j3 or (n — l)n a (n — 2) (3 where a is a 132- 
avoiding permutation on the elements n — £— 2, . . . , n — 3 and (3 = (n—£ — 3)(n—£—A) . . . 321 
or /3 — (n — £ — 3)(n — £ — 4) . . . 312. Thus, the highest power in Qn' 1 '*' 2 ^ is x n_£ ~ 5 which 
has a coefficient of 4CV 
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4 Q<™ (x) = (*) where k, £, m > 1 

By Lemma [H we need only consider Qn'132 (x). Suppose that k, £, m > 1 and n > k + m. 
It is clear that 72, can never match MMP(£, k,0,m) for m > 1 in any a G <5' n (132). If 
a = cti . . . a n G S' n (132) and cr^ = n, then we have three cases, depending on the value of i. 

Case 1. % < k. It is easy to see that as we sum over all the permutations a in 

our choices for the structure for Ai(a) will contribute a factor of Cj_i to 132 fa) since 

the elements in Ai(a) do not have enough elements to the left to match MMP(£, k, 0, m) in 



(e,k-i,0,m) 



X 



a. Similarly, our choices for the structure for B^a) will contribute a factor of 
to Q; 

i32' m fa) since <7i . . .cTj will automatically be in the second quadrant relative to the 
coordinate system with the origin at (s, a s ) for any s > i. Thus, the permutations in Case 1 
will contribute 



k-i 

E 

i=l 



r n (l,k-i,0,m) , x 
^i-lVn-j,132 l x J 



t° Qi,'l32' ^fa) 



Case 2. k < i < n — m. It is easy to see that as we sum over all the permutations a in 
^(132), our choices for the structure for Ai(a) will contribute a factor of Q\_ x i 32 ' fa) to 

Qnim fa) since the elements in Bi(a) will all be in the fourth quadrant and <Xj = n is in 
the first quadrant relative to a coordinate system centered at (r, ay) for r < z in this case. 
Similarly, our choices for the structure for Bi(a) will contribute a factor of Qn-fi^i fa) 
to 

i32' m ( x ) since 0\ . . .Oi will automatically be in the second quadrant relative to the 
coordinate system with the origin at (s, a s ) for any s > i. Thus, the permutations in Case 2 
will contribute 

n—m 

x(^-l,fc,0,0) / x^^O.O.m) . 



Vi-1,132 WV n -i,132 W 



to QK ,m) fa) 



Case 3. i > n — m + 1. It is easy to see that as we sum over all the permuta- 
tions a in 5^(132), our choices for the structure for Ai(a) will contribute a factor of 
Qi-ii32 ' m ^ ^fa) to Qni32' m \ x ) since <7j = n will be in the first quadrant and the ele- 
ments in Bi(a) will all be in the fourth quadrant relative to a coordinate system centered at 
(r, ay) for r < i in this case. Similarly, our choices for the structure for Bi(a) will contribute 
a factor of C n -i to Qniszt™^ (x) since Oj where j > i does not have enough elements to its 
right to match MMP(£, k, 0, m) in a. Thus, the permutations in Case 3 will contribute 



E 

i=ra— m+1 



n (£-l,k,0,m-{n-i)) ( \ r i 
Vj-1,132 W^n- 
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to Qn'132 (x). Thus, we have the following. For n > k + m, 

k— 1 n—m 

C H w = E c^QtV£ m) w + E ^^' 0) (-)«S } (-) + 

i=l i=k 
n 

e QE:i3 2 o ' m " (n " j)) (^)a-,. (io) 

i=n— rra+1 

Multiplying (TTO]) by t n and summing over n will yield the following theorem. 
Theorem 13. For all £,k,m > 1, 

k+m—l 

Q?£°> m \t,x) = E c p* + 

k-2 / k-i+m-2 \ 

t^df [Q^^^X)- E C rt r ) + 
i=0 \ r=0 J 

(k-2 \ / m-1 \ 

Q& A0 '°\t, x) - E Qf 32 0Am) (t, x) - E at 6 + 

a=0 /\ b=0 J 

m—1 / k+m—j—2 \ 

^E^ ^32 1,feAm_i) (*^)- E ^ ■ (") 

j=0 \ s=0 J 

Note that we can compute Qf^°' G \t,x) = Qi^'° ,k \t, x) by Theorem [6] so that (TTTT) 
allows us to compute Q^' ''™^^ x ) f° r an y k,£,m> 0. 

4.1 Explicit formulas for Q^'^ (x)\x r 
It follows from Theorem [13] that 

Qg 2 1A1) (M) = l+t + tQSS 1 ' 1 ' '^^) (Q^\t,x) - l) +t (q^^M) - l) , (12) 
QU°' 2) (t, x) = l + t + 2f + tQg- 1Xm (t, x) (Qg A2) (t, *)-(! + 1)) + 

t (QS™ 2) (M) - (1 +t) +t (Q?32 1>1A1) (M) " l)) , 



and 



Qg°' 2 )(t, x ) = i + t + 2t 2 + 5t 3 + t(Qf 3 ' 2 1A2) (t,x)-(l + t + 2t 2 )) + 

t(QS£ 1A0A (^)-i) (QSr 2) (t,,)-(i + t)) + 

t (g&^Ct, - (1 + 1 + 2t 2 ) + t (Qf^it, x) - (1 + *)) 
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One can use these formulas to compute the following. 

Qiat^fax) = l + t + 2t 2 + 5t 3 + 2(5 + 2x)t A + (17+ 17a: + 8a; 2 ) t 5 + 
(26 + 44a; + 42a; 2 + 20a; 3 ) t 6 + (37 + 90x + 129a; 2 + 117a; 3 + 56a; 4 ) t 7 + 
(50 + 160a; + 305a; 2 + 397a; 3 + 350a; 4 + 168a; 5 ) t s + 
(65 + 259a; + 615a; 2 + 1029a; 3 + 1268a; 4 + 1098a; 5 + 528a; 6 ) t 9 + 
(82 + 392a; + 1113a; 2 + 2259a; 3 + 3503a; 4 + 4167a; 5 + 3564a; 6 + 1716a; 7 ) t 10 + ■ ■ ■ . 

It is easy to explain the highest coefficient of x in Qn'132 ( x )- 

Theorem 14. For n > 3 + £, the highest power of x that occurs in Q^xm^^) ^ s % n ~ 2 ~ l 
which occurs with a coefficient of ACnC n -t-2- 

Proof. It is easy to see that the maximum number of MMP(£, 1,0,1) matches occurs in 
a G S' n (132) when a is of the form n r a (n — 1), n r (n — 1) a, (n — 1) r a n, or 
(n — 1) r n a where a is a 132-avoiding permutation on the elements 1, . . . ,£ and r is a 
132-avoiding permutations of the elements £ + 1, . . . , n — 2. Thus, the highest power of x 
in Q^i32 ^(e) for n > £ + 3 is x n ~ 2 ~ e which occurs with a coefficient of 4C^C n _£_ 2 - D 

We can also explain the second highest coefficient in Qniil ( x )- 
Theorem 15. For n > 5, 

Qn'l32' \ x )\x n ~ A = 8C n _3 + C n _4. 

Proof. In this case, the recursion for Qni^ l \ x ) is 

n-l 

Qn,132 ( X ) = Qn-l,132( X ) + Qi-1,132 ( X )Qn-i,132 ( X ) • 

1=1 

It was proved in [9] that for n > 1, the highest power of x that occurs in Qni32'°\ x ) * s xn ~ 1 
which occurs with a coefficient of C n _x- It was proved in [10J that for n > 3, the highest 
power of x that occurs in Qn'132 ( x ) * s xTl ~ 2 which occurs with a coefficient of 2C n _2- It 
follows that 

Qn',132 ^ (^) U"- 4 = Q n -i,13l( X )\x n - i + Qn-i,132( x ) \x"~ 4 + Qi-2,132 ( x ) \x"~ 4 + 

n-2 

Qi-1,132 ( 3 ')U i - 2 Qn-i',132 ( a; )U"- i - 2 - 

i=2 

It was shown in j9] and [10] that 



n (o,i,o,i), 

Vn-1,132 1 


[x)\ x n-4 


= 2C n _3 + C„_4 for 


n > 5 


n (iA0,D ( 

Vn-1,132 1 


[x)\ x n-4 


= 3C n _3 for n > 5, 


and 


n (0,l,0,0), 
Vn-2,132 1 


[x)\ x n-4 


= C„_ 3 for n > 5. 
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Thus, for n > 5, 

n-2 

Qn'132 \ x )\x n ~ 4 — 2C n _3 + C n _4 + 3C n _3 + C„_3 + C*j_22C n _j_2 

i=2 

n-2 

= 6C„_3 + C n _4 + 2 Ci-2C n -i-2 

i=2 

= 6C n _3 + C n _4 + 2C n _3 = 8C„_3 + C n _4. 

□ 

The sequence (Qn 132 (fy)n>i starts out 1, 2, 5, 10, 17, 26, 37, 50, 82, . . . which is the se- 
quence A002522 in the OEIS. The n-th element of the sequence has the formula (n— 1) 2 + 1. 
This can be verified by computing the generating function Q132' (t, 0). That is, we proved 
in [9] and \W\ that 



^(1,0,0,1)/. n\ l~2t+ It 2 

Q132 (*,0) = —p. -^,and 



i-r 

- 2/ 

TT-t)3 



1-t (1-t) 2 ' 

Plugging these formulas into f[T2"j) . one can compute that 

.(LW) /■ ^ 1 -3t + 5t 2 -2t 3 + t 4 



(1-*) J 



Problem 3. Find a direct combinatorial proof of the fact that Qn'132' (0) = — l) 2 + 1 
for n > 1. 



Qi32 A1) (* ) x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + (33 + 9x)t 5 + (71 + 43a; + 18a; 2 ) t G + 
(146 + 137a; + 101a; 2 + 45x 3 ) t 7 + 
(294 + 368a; + 367a; 2 + 275a; 3 + 126a; 4 ) t 8 + 
(587 + 906a; + 1100a; 2 + 1079a; 3 + 812x 4 + 378a; 5 ) t 9 + 
(1169 + 2125a; + 2973a; 2 + 3463a; 3 + 3352a; 4 + 2526a; 5 + 1188a; 6 ) t 10 + ■ • • 

Q$£' 0,1 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + (116 + 16a;)t 6 + 
(308 + 89a; + 32a; 2 ) t 7 + (807 + 341a; + 202z 2 + 80a; 3 ) t s + 
(2108 + 1140a; + 849a; 2 + 541a; 3 + 224a; 4 ) t 9 + 
(5507 + 3583a; + 3046a; 2 + 2406a; 3 + 1582a; 4 + 672a; 5 ) t 10 + 
(14397 + 10897a; + 10141a; 2 + 9039x 3 + 7310a; 4 + 4890a; 5 + 2112a; 6 ) t u + ■ • ■ . 
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It is not difficult to show that for n > k + 3, the highest power or x that occurs in 
Qn i32' 1 \ x ) * s x n ~ k ~ 2 which appears with a coefficient of (A; + l) 2 C n ^k-2- That is, the 
maximum number of occurrences of MMP(k, 1, 0, 1) for a o G S n (132) occurs when a is of 
the form xt(3 where x G {n — k, . . . , n}, (3 is a shuffle of 1 with the increasing sequence which 
results from (n — k)(n — k + 1) . . . n by removing x, and r is a 132-avoiding permutation 
on 2,. — k — 1. Thus we have k + 1 choices for x and, once x is chosen, we have k + 1 
choices for /?, and C„_ fe _ 2 choices for r. 

<2& 2 1,0 ' 2) (£, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + (32 + 10x)t 5 + 
(62 + 50a; + 20x 2 ) t 6 + (107 + 149a: + 123a; 2 + 50a; 3 ) t 7 + 
(170 + 345a; + 433a; 2 + 342a: 3 + 140a: 4 ) t s + 
(254 + 685a; + 1154a: 2 + 1327a: 3 + 1022a: 4 + 420a; 5 ) t 9 + 
(362 + 1225a: + 2589a; 2 + 3868a; 3 + 4228a; 4 + 3204a; 5 + 1320a; 6 ) t 10 + • • • . 

Qn2°' 2 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + (105 + 27a;)t 6 + 
(235 + 140a; + 54a: 2 ) t 7 + (494 + 470a: + 331x 2 + 135x 3 ) t 8 + 
(1004 + 1301a; + 1275a; 2 + 904a: 3 + 378a: 4 ) t 9 + 
(2007 + 3248x + 3960a; 2 + 3773a; 3 + 2674a; 4 + 1134a: 5 ) t 10 + ■ ■ ■ . 

Qvn ,0 ' 2) (t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + (373 + 56a;)t 7 + 
(998 + 320a: + 112a; 2 ) t 8 + (2615 + 1233a: + 734a; 2 + 280a; 3 ) t 9 + 
(6813 + 4092a; + 3131a: 2 + 1976a: 3 + 784a; 4 ) t 10 + 
(17749 + 12699a; + 11223a; 2 + 8967a: 3 + 5796a; 4 + 2352a; 5 ) t n + • • • . 

<5i32 2 '°' 2) (^ x) = l + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + (107 + 25x)t 6 + 
(233 + 146a; + 50x 2 ) t 7 + (450 + 498a; + 357a; 2 + 125x 3 ) t 8 + 
(794 + 1299a: + 1429a; 2 + 990a: 3 + 350a: 4 ) t 9 + 
(1307 + 2869a; + 4263a: 2 + 4353a: 3 + 2954a: 4 + 1050a: 5 ) t 10 + • • • . 

Q { S'°' 2 \t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + (348 + 81a;)t 7 + 
(811 + 457a: + 162a: 2 ) t s + (1747 + 1625a: + 1085a; 2 + 405a: 3 ) t 9 + 
(3587 + 4663x + 4443a: 2 + 2969a: 3 + 1134a: 4 ) t w + 
(7167 + 11864a; + 14360a: 2 + 13201a; 3 + 8792a; 4 + 3402a; 5 ) t 11 + • • • . 

Q§2'° ,2) (t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + 429t 7 + 
(1234 + 196x)t 8 + 2 (1657 + 578a; + 196a; 2 ) t 9 + 
(8643 + 4497x + 2676a: 2 + 980a: 3 ) t 10 + 
(22345 + 14839a: + 11622a; 2 + 7236a; 3 + 2744a; 4 ) t n + ■ ■ ■ . 
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Problem 4. In all the cases above, it seems that for n>£ + k + m+l, the highest power 
of x in Qn i32' m \ x ) i s x n ~ k ~ e which appears with a coefficient of at^,mQn-t-k-m, for some 
constant a^k,m- Prove that this is the case and find a formula for ae t k, m - 

5 Q ( :,m d) 0"0 = Qnf£ h) if) where a, b, c, d > 1 

By Lemma (TJ we only need to consider the case of Qn 132 ( x )- Suppose that a,b,c,d> 1 
and n > b+d. It is clear that n can never match the pattern MMP(a, b, c, d) for a,b,c,d> 1 
in any a G 5 n (132). If a = <j\ ... a n e 5' n (132) and <Tj = n, then we have three cases, de- 
pending on the value of i. 

Case 1. % < b. It is easy to see that as we sum over all the permutations a in ^(132), 
our choices for the structure for Ai{a) will contribute a factor of Cj_i to Q^im, ( x ) since 
the elements in Ai(a) do not have enough elements to the left to match MMP(a, b, c, d) in 
cr. Similarly, our choices for the structure for Bi(a) will contribute a factor of Q^-^im ^ ( x ) 
to Q ( l 

132 ( x ) since 0\ . . .Oi will automatically be in the second quadrant relative to the 
coordinate system with the origin at (s, a s ) for any s > i. Thus, the permutations in Case 
1 will contribute 

b-i 

\(a,b—i,c,d) , 



E 1 



i=l 

~,(a,b,c,d) . 



Case 2. b < i < n — d. It is easy to see that as we sum over all the permutations a 
in S& (132), our choices for the structure for Ai(a) will contribute a factor of QW i^' {x) 

to Qn'132 ( x ) since the elements in Sj(cr) will all be in the fourth quadrant and oi = n is 
in the first quadrant relative to a coordinate system centered at (r, a r ) for r < i in this 
case. Similarly, our choices for the structure for Bi(a) will contribute a factor of Q^fi 132 ( x ) 

to (3^132 l 2 -) since cri . . . cr^ will automatically be in the second quadrant relative to the 
coordinate system with the origin at (s, a s ) for any s > i. Thus, the permutations in Case 
2 will contribute 



(a-l,b,c,0) , \ n (a,0,c,d) / \ 
132 WV n -i,132 \ x J 



i=b 



Case 3. i > n — d + 1. It is easy to see that as we sum over all the permutations a in 
5^(132) , our choices for the structure for Ai(a) will contribute a factor of Q °i 1 (x) 

to Qni32 ( x ) since Oi = n will be in the first quadrant and the elements in Bi(a) will all 
be in the fourth quadrant relative to a coordinate system centered at (r, a r ) for r < i in 
this case. Similarly, our choices for the structure for Bi(a) will contribute a factor of C n _j 
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to Qn'132 ( x ) since Oj, where j > i, does not have enough elements to its right to match 
MMP(a,b,c,d) in a. Thus, the permutations in Case 3 will contribute 

n 

E n {a-l,b,c,d-{n-i))(^ r 

i=n—d+l 

to Q ( ° 

132 ( x )- Thus, we have the following. For n>a + b + c + d+ l, 

6—1 n—d 

Q { :?£ d) (*) = E Ci-iQt£$*{x) + E Q£ffi%)Q%l$W + 

i=l i=b 
n 

E Qt^'^H^Cn-,. (13) 
i=n— d-\-l 

Multiplying f|T3|) by £ n and summing, we obtain the following theorem. 
Theorem 16. For all a,b,c,d > 1, 

b+d-l 

Q13V (t' x ) = C p t p + 

p=0 

b-2 / b-i+d-2 \ 

i=0 V r=0 / 

t ^32 1AC ' ^, *) - E C ^ (QS C ' d \t, X) ~ E + 
d-1 / b+d-j-2 

j=0 \ s=0 

Thus, for example, 

g& w) (t,ar) = l+t + tgS' 1 ' 0) (* ) x)(Q? 3 f' 1) (i, a ;)-l) + 

t(g& w) (*,x)-i). 

and, for k >2, 

= l + t + tg£ 1 ' 1 ' 1 '°Ht,a:)(Qf3f' 1) (t,x)-l) + 

tCgfc^fc*) - 1). 

giaa' 1 ' 1 ^*, ^) = 1 + t + 2t 2 + 5t 3 + 14f 4 + (38 + 4x)t 5 + (99 + 29a; + 4a; 2 ) t 6 + 
(249 + 135a; + 41a; 2 + 4a; 3 ) t 7 + (609 + 510a; + 250a; 2 + 57a; 3 + 4a; 4 ) t s + 
(1457 + 1701a; + 1177a; 2 + 446a; 3 + 77a; 4 + 4a; 5 ) t 9 + 
(3425 + 5220a; + 4723a; 2 + 2564a; 3 + 759a; 4 + 101a; 5 + 4a; 6 ) t 10 + • • • , 
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Qf£ Xl \t, x) = 1 + t + 2t 2 + 5t 3 + Ut 4 + 42t 5 + (123 + 9x)t 6 + 
(350 + 70x + 9x 2 ) t 7 + (974 + 350a: + 97x 2 + 9a; 3 ) t s + 
(2667 + 1433a; + 620a: 2 + 133a; 3 + 9a; 4 ) t 9 + 
(7218 + 5235a; + 3079a; 2 + 1077a: 3 + 178a; 4 + 9a; 5 ) t 10 + • • • , 

and 

Qi32 1A) (t, x) = 1 + t + 2t 2 + 5t 3 + 14t 4 + 42t 5 + 132t 6 + (413 + 16x)t 7 + 
(1277 + 137a; + 16a: 2 ) t s + (3909 + 752a: + 185a; 2 + 16a; 3 ) t 9 + 
(11881 + 3383a: + 1267a; 2 + 249a: 3 + 16a: 4 ) t 10 + ■ ■ ■ . 

It is easy to explain the coefficient to the highest power that appears in Q^iil'^i 30 ) f° r 
k > 1. That is, the maximum number of matches of MMP(1, 1, 1, 1) for a G S n (132) is 
when a is of the form x a f3 where x G {n — k, . . . , n}, (3 is a shuffle of 1 with the sequence 
(n — k)(n — k + 1) . . . n with x removed, and a — 23 . . . (n — k — 1). Note that we have 
k + 1 choices for x and, once we chosen x, we have k + 1 choices for ft. Thus, the highest 
power of x that occurs in Q^iil^^) ls x n ~ h ~ 3 which occurs with a coefficient of (k + l) 2 
for n > k + 4. 



We also have 



QSa 0,1,1) (*,0) = l + t\^-^J , and 
,(0,1,1,1),. ^ l-4t + 5t 2 -t 3 



l-^ 2 



(1 - 2t) 2 (l - t) ' 



to compute that 



,(1,1,1,1) . , 1 - 6t + 13t 2 - 1 It 3 + 3t 4 - 2t 5 + t 6 



Q& w '(t,0) 



(i-t)(i-2ty 



Note that Qi^' 1 ' 1 ^, 0) is the generating function of the permutations that avoid the 
patterns from the set {132,52314,52341,42315,42351}. 

Finally, we can also determine the second highest coefficient of x in Qn'iil'^ix). 



Theorem 17. For all n > 6, 

^3 2 1 ' 1) (*)U- = 17 + 4 



n — 3 
3 
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Proof. The recursion of Q^iil ( x ) * s 



n-1 

Qn'l32 ( X ) = Qn-l,132( X ) + ^] Qi-1,132 ( X )Qn-i,132' 



X). 



For n > 3, the highest power of x which occurs in Qni32'°\ x ) * s xn 2 an d for n > 4, the 
highest power of x that occurs in Qni32 ( x ) is x ™~ 3 - It follows that for i — 2, . . . ,n — 3, 
the highest power of x that occurs in i' 132 C 2 -) i s x " 6 - ^ follows that 

Qi.isV ' > ( x )U"- 5 = Q n -l,132( a; )la:' l - s + Qn-2,132( x ) Ire™" 8 + ( x ) U"-5 + 

n (0,l,l,0) , \ I , n (0,l,l,l)/ vi 

Vn-2,132l X JU'"- 5 "T Vn-l,132l X JU'"- 5 - 

But for n > 6, we have proved that 



n — 3 
2 



QSSSSWI^ = 6 + 2^ 

Qn-2,132( ;E )la;' l - s = 2, 

2Q n l3,132( ;E )U' l - s = 2Ci = 2, 

QSiS^lx"-" = 2 + ^ 2 3 ) , and 

Qi-l,132( X )lx n - s = 5 + f ^ 

Thus, Qji^^Un-B = 17 + 4(V)- □ 
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